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ABSTRACT . ^ ' ' ' 

Approximately 1,200 University of Illinois Committee 
on School -Mathematics (OICSM) alge^bra sti^6nt^ were divided iivto 6 
groups depending on ^rade (8th or *9th) , .version of OICSM firs-t course 
text used 1958 or 1959)-, an.d duration of study. These students and 
.nearly 700 non-^OIQSM algebra students were given Cooperative Algebra 
Test (Coop Algebra) forms T, ^X, and Y# Analysis of co variance was 
used t6 compare gr-oap; means' on this test, with adjustments for 
ineguaTities* betw.een groups on the. -Differential Aptitude Tests of ^ 
Numerical Reasoning and of Verbal Ability^ The DiCSM students showed 
greater achievemen.t than did the non-OICSM students. This was also 
true of four, of the six OIGSM groups taken separately. The adjusted 
Coop Algebra means of the other two DJCSM groups. were not 
significantly different from that of the control sample. Possible 
reasons for these results are discussed. (Author/BB) ^' 
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Foreword- 



The problems of evaluati«f new curyicultmi matexials such as t , 
those j>roduced by UICSM are maniford and not e^sy to solve. A pri- , 
ma'ry objective which UICSM set for itself when it wasT)'rganized in 
1951 was to improve ihe learning 6f the skills and facts comprising 
^the college preparatory sequence found fin most high schools at that 
time. Ii>.trying to achieve this objective, UICSM mstde rpiajor changes 
in pedagogy and major changes in content especially with respect to 
logical organization, Teaching-by*digcove'ry replaced teaching*by- 
telling in order to build interest and to tap the creative talents of 
students. We maintained very high standards of pre^cision of language 

in our instructidnal mat^lals. In order to achieve the understanding 

. r ^ 

which intellectual integrity demands as a ^prerequisite to acquisitipn 
of skills, .we* introduced the^otion of a deductive ^rgani'zation of elernen 
tairy algebra. Thus students darivied the theor^m^ which justified the 

^usual manipulation^rules and they became aware of the logical connec- 
tions aonong the mani6uiation rules [e. g. , the rules for combining like 

> monomials and the rule lor combining like radicals are logie^ conse-. 
quences of the san;ie principle]. Topics frorA the elementary theor'y df 

sets were Jjitroduced to give students insights into what rnade the 

^ . , . ' ' . * 

mechanical procedures work 'when they solved equations and inequations 

or when they solved systems of equations by graphing. Thus UICSM * 

students had the opportunity not only to acquire the skills and knowledge 

\expected from the * 'traditional* * cfirricui|im but'a,lsOttb learn xit^athemat- 

ijcal ideas and techjiiq^ies which were not p-rovi5e(^ for in school 



•nx- 



imitliematico arr.^ranis prior to UICSM. , In addition, ;as we were toid , . ' ' 
by cpoperatictg t^sachers iav experimental clashes and .as we observed on * * 
our visits to'th'ese classrooms, UICSM students were routjinely develop- 
in^ insights into mathematics and attitudes toward new pi^oblems which ^ 
were acquized by only the best* students in the ^best of traditional classes 
an^d whicli mathemritics educators liave professed *to be amons the most 
S3.gnifioani outcomes of<>inst ruction. * 

Any coTnprehensive evaluation pa-ogram should consider both the pri- 
rna^y skil^-^nd-Jknowledge objective y/hich is common to both our program , 
^nd the tTCiditi'GXLal one, and the rather astounding seconda2:y objectives\ ^ 
which v/e" appeared to accomplish almost as iDy-products/ In the early 
years ol our v/ork' we v/l-re able to look only»at the primary objective in 
making comparative studie^^: of UICSM students aYid students trained in the 

traoitior^r curriculum, .Natarally, it was not pgssible to'make compara- 

V ' * - * - 

tive studies^with respect to new content, and we had neither the skill not«- 

the timx t-o^deveJop objective, testb for n:/alang comparative studies with 
respect to the doeiopment of msight and creativity in attacking new prob- 
lems. What %e could do and what we did. was to collect data on students' * y 
achievement as m^casured by standardized afg^abra ancj geometry tests 
which were ciesigncd for the pre-i950 traditional c;ur;ricalujm. We do not 
prcjlend t^at these tests have provid-^d us with a complete description of 
our j^tudents' achievement, and we recognize that the language u^se^in 
many oi the items on these tests was somewhat unfamiliar to our* students/* 
Neyertheless^^ wc were willing to use the test results as a rough guide in 
reyiv^ing our instructional materials. The study reported below is the ' ^ 

first we have: pul^li^hed based on 'an analysis of the data, collected by means 

■ ' . . 

ox ^uch tests. ^ , * ^ ' * * ' • 



The rei^lts the analysis -a re^not as satisfactory as ^^e* might have 
hoped. Achievement by students in our pilot and participating schools 
^was not unifSrmly high, , These results are in^aocordwiti^the subjective 
reports. we have received from teachers .and*with very rough analyses' 
which we ca-rried out some'Vears ag9 as the data were coUfected.^ Tiiese 
preliminary fin(Jings bersuadedus to^revise our instructk)nal materials 
for our advanced units in the direction of including rnany review sections 
•of miscellaneous n>anipulative.exercises^^ The present study will be 
useful to the extent that the objectives measured by,the tests are valid 
in our continuing curriculum development Work.^ ' ^« * 

*The report which follows is the fir^'t to be produced by the/newly- 
organized l*e search se(ption of UlCSM, tit is directed to a vatied audience-*- 
research workers in mathematic^ education, teachets^ administratoys, 
and. others who have bden interested in UICSM. 6uch variety posed a 
problem for the ^^uthors. Professors Tatsuoka and Easley have felt 
obliged to include sxiffici^ent details of the statistical analysis to a^nsi^er . 
t?be research "^Svorkers' questions but, at the same time,"^d not wish to 
c^verwheim theOaonstatistically oriented 'reader. They Have, consecjuently, 

' 1 ' ■ * ^ • ' ^ 

Employed the*device ^of setting off the fechnical Sections with wider ^margins 
and closer spacing, so thag: tKe»geheral reader may skip th^se il Jie wishes. 

They have also provided an abstract for those who wish a brief resume, 

' * ' . ^/ 4 . *■ 

0;ur research section, unHer^the .direction of Professor Easle^, is 
* -^^ * ■> ' ' • ^ 

presently engaged in fu^her analysis of ^v^ilable data, in collecting new 

* ' ' , ^ ^^^^ .V ' . * 

data for studies underway, and ii^esigning further studies t*elated to the 

teaching and iearfjiing of mathematics. These research actittKies will play 

an'impprtant rojle in the developmeYit of ri^ew curriculum materials which 

is the primary job of UICSM. ' * " * ^ ' 

w * 



Ma^j: Beberman 
Director, UICSM 



tJrbana^ Illinois ' ^ ' O 

September 1, 1963^ * , 
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..Comparison (?€ UICSM vs. V traditional' ' Algebra Classes 
, ' ■ . • •. ■ on Coop Alge.bra Test Scores^ . ." . 

-> • ■ » ■ , ••• : 

, y Maurice M.•^Tatsuoka and J* A, Easley, Jr,^ 



, • . Abstract ^ ^ - .'^ " • • ' 

This report describes the results of. an evalu^txbn study ' ' • 
^r'^^r^aXW^ ^P^°^i«^ately 1700 UICSM and nearly 700 non- 
UICSATalgebra studentg. The fortyier are designated the 
^experimental ' sample and the latter tHe ".control" sample. 
The exi^erimental sarpple was- broken down into six groups- de- 
•pendiftg on grade (8th or 9th), version of UICSM First Cburse . 
• usee? (1958 or 1959), and duration of stutfy prior to 'testing. 

. f^chievemejnt irt algebrpL was measured by the Cooper- • ' 

. atiVe Algebra Test (Elenfientary) , FormI T, X, and .Y, The 
< analysis of CQvariance was ^sed in comparing group means 

on this test, with adjusti^nts ior inequalities between groups ^ 
• . Differential AptituTe T«lts of Nujnerical Reasonine * 

and of Verbal Ability. * 

Vith these adjustments, the ^perimental sample as a. 
whol-e showed significantly greater achieve^nent'than the con- 
trol sample.. This was alscttrue of four. of the six experi- 
mental groups taken separately^, • . . 

, The adjusted Coop Algebra means of the other two groups 
were not significantly different from that "of the eoiitrol simple. 
Possible reasons for these results" are discussed in the, report. 

Description- of Samples Tested in the Study 

^ The, exp\rim,ental sample compi^sed 1 , 705 students in 75 eighth- ^and 
ninth-grade classes taking the UICSM First Course' (Units I-IV) during the' 
1958-59 and ,1959-60-schooryears. They fall in th^ dipper two-thirds of 
the/college preparatory students in 38 s.chools scattered throughout the 
country. The sanr^nles wgre not arrived at by stratified' sampling but-by 

i 

report of the same title.. 



foVd&^r^^^t *° V"' f^f^i-""" O'iginally obtained and sobjected 

repo^tfe^aTelr/'"^ ^^r''- Jr. in an unpubLhed; 

Th? authors are especially indebted to Judy Boyl^ for fcom*.iHr,„ ,1 ' ^ ^ 
aZ.o.'ndebted .o Kobe. ^..^^ fn'^b^e'r^frbl^p^^-^S-on^^JTs. 



historical* accident, from schools which volunteered to try the UlCSlil mate- 
rials. (Due to this fact,' it was necessary to introduce statistical controls, 

described in tlie section on ''Statistipal Analysis.'') This sarpple was 
divided into six groups (designated by E^, E^, E^, E^, Eg, and E^)> de- 
pending on the grade, the school year in v/hich the UICSM First Course was 
tal^n, and the tirrie of testing. Groups E^ and E^'contained 25% of the 
UICSM students starting First Course in September, 1*958, and the other .• 
four represented 43% of the. students starting in September, 1959. 

The\particularr year (1958-59 or 1959-60) 'in which the course was 
taken is important because the UICSM.material t)ublished and first used 
in the fall of 1959 was the result of a revision which, it v/jkS hoped, 'wouldc 
improve student performance bn standard high school algebra tests. Whilc^ 
earlier versions of the UICSM^texts had concentrated prirriarily on making 
ideag clear, the 1959 revisions reflected th|a realization that clarity of con- 
cept development was not enough to ensure that concepts are retailed by • 
students in a useful form. Although further improvement of clarity of cc5n^ 
' cepts was not avoided in making these revisions, the principal purpose for 
< the revisions was to provide increased practice in u$ing mathematical ideag 
The diversity of ways in which opportunit5es for practiqe were increased 
in the 1959 versions M Units I-UI exemplified by the new 'topics and treat- 
merits briefly described below. ' • , 

In Unit I, the explanation of^and the exercises^n the grouping con-' 
' ventions were considerably expanded, and* the term *''unabbreviating^^ was 
introduced to refer to the procedure of putting omitted symbols back into 

^ an expression. The treatment of some of^the principles and concepts 

. ' ' • , -s 

f • ♦ ♦ • 

relating to real numbers was made^more explicit, and more exercises, ' 

were included which involved the use and recognition of basic principles 

'fpr real numbers. .In-Unit II, the treatment of simpUfication problems 
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I 



involving division waTs consideral^ly expanded and the total number of Iv^ple- 
mentary exe.r,cises was approximately doubled, ^w,*exercisesN^er^- 
mainly concerned with proofs and ^simplification problems involving divi- \ 
sion-~in contrast to the old supplementary^xetcises (still retained) which 
concerned only substitution and algebraic sirh^lifitation. in^Unit Illi the 
applj cation o£ uniqueness ^nd cancellation princif/les to tl/e solutioai of ^linear 
quations and **inequ^ions, qii^dratic equations and square^roots received 

r ^ • • ^ • . ' * 

a\b^ore'detail6d treatment. 

Oualilatively, leacher^^nd writers were satisfied that these lul^^^nges 

.-.^ • ' ^ • . ' ' . • . ' ■ . 

wdutd promote an increased mastery of algebraic skills by the pupils. It 

1'= ' / . ' ■' ' ' 

is mpst interesting, therefore, to intquire whether students wsing^the new 

•. . * . " • 

edition showed such an increas-ed mastery^, as measured by a test empha-* 

-\ • ' . f ' # , 

\'*. • ' . f 

sizirifl manipulative skill. ^ ^ , . ^ 

* s 

he time of testiYig for achievement in the experimental BdL'm^e was 

<* 

rather^\disunif9rm from on"e class^fb another.' s\>me classes (ti^ose in 
groups Uii^^a^d E^V-were tested at the end of the school year in which they 
had sfanted tl^eir UICSM courses, and mpst of them had'just begun their 

5re a\a disadvan- 
tage in tHa,t the criterion tests (described later) inclu^ied item^ on exponents 
and on geometrical applications of algebra— topics whiph were not covered 
in Units 1 -Sr^^'^'Qtl^er classes v/ete tested upon completion of Uni ^^ - W hich 
generally iook place ^ome time during the f^H of the S'Chooryear following 
the one in whi<::h they had begun the course. The distribution^^of times of 
"testing of t|ie various classes is indicat^^raphic^lly in Figure 1, which 
' also_shows Ithe size of the groups ihto whirch the*exp^rimental and cbn&rol 

sarnples we^e divided. *' ^ ; 

. . ^ ^ ^ — " ' '^^ ' ' 

Note tSiat the year and month in v^hich each group begAn its algebra ^ 

' 1 • ' ' ' 

course^ is ii^iicated b^*the , position of the left border of Its block along the 



Study ofpnit 4 at the time of testing. These students we] 
.1 




• Block diagram shqwi^ig the groups into which- the control and experimental 
samples were divided. The left pdge of each block indicates the time at 
' Q wljich that group began its, coursci. The distribution of fifnes of testing 
for these groups is indicated by llie right hand boundaries 'of the blocks. 
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time'^';*a1e scpar,aling the* blocks repfresetiting the control and fex^rihiental 
groups.- The i/ight-Tiand border indicates the tiixie of testing with the. Coop 

'Algebra Test. For those group's which. coi>tained classes that varied in » 

* - "* • * 

timet of testing, the right-hand border^is made step-wise to 'indicate the ' 

variations. The heights of these steg5*a^:e drawn rou^^ly proportional 

'to, tlj^e number of students tested in each time period!; tThe total height of 

, each block is proportional to the group size". ' ' ■ , * 

The breakdown of the experimental sample into six groups, in accord- 

ance with the characteristics, described above, is summarized in the upper. 

portion of Table 1, below: . ^ ' . 



Table 1. Subdivisi©ns 'of experim*ental and ^control samples , 

into several groyp^based on some relevant features. 



u 

OA 

W 



U W 



Group ' Grade 



4> 

g] 'E 
S 
in 



'1 
2 



8 
9 
9 
9 
9 
9 



. Year Coijjrse » 
Was 

Begtin- Time of Testing 



N 



1959 
19*8 
195S 
1959 
1959 

1959 

^ • 
1958 • " 
19t9 



May '60-Mar '61 226 
• May '59 ' 118 
- Sept Deo '59 • 270 



■ May '60 

Nov - Deo '60 
Jan ' 64 

May '59 
May '.60 ■ 



574 
^ 382 



. ' 135 

5J5 
.^161' 
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The coi'itrui Si^nipJe c wjiV]>jfif.-.ed.-ty7^^>tudents* ii\ Z6 ninth-«grade classes ,^ 



takinj^ *\ oiivrnlionar* ^fl,^eb,rcl co\iTj^e$*''d^ing 193^-59 'and 1959-60 in schodls. 
which Tilsu h.ui\UIC'SM ^Itx^ses, Th^ cOiiti:ol cldsses we.re from U or tlv^ 38 
L'chooU re}H-ebcnted ill'lVc''C*:q^e^'•u*)<^^^^^^ 10 othe rs^"y{Ali schoolls* 

usin>; UICSM text wo re cncouiM;^od^to .set up both experimental and control 
cl'issos but'inany were un^fblc ia dcrs'o or fyilc'd to administer all'the te8t^.« ) 

Thi3 s.ampLe .v^-a.s divided into only <wp groups' asjshown in^the lower portion 
of TablQ 1, (C, : the 1958-59 cUs-se^:" ,C^:' the 1959-60 classes). fFurthef 
bubdivMsiOt) wa"^ unnecessary becausb, unlike those an the experimental ' 
sample/ the conli'ol classc*s were u-niform witn respect to grade and time , ' 
of testing. ^ That is, ail control class^J^erc 9th-grade classes, aiici all 
were tcslt;<t^t 1^^* end 'of iR^. school year m whicHVthey l\ad their (irst; - 

Test Data Used " • * ^ ^ < , \ ^» ' 

^ ^ J ; 

Tl)o criterion variable in tej>ms of \vhich intergroup comparisons 
were mad<- was the Coop(»ralive Elementarry Algebra Test (Forms T, ^ 
and Y), pub]i>shed bv the Edu^c-fttional Testing Service. This ^test empha- 
sizes computational skills,^. and hence proviides an»**acid tes^t'^'for UICSM- ' 
trained students- -especially for those who were taught y^ith material prior 
t(Nhe 1-959 rc:vision. ^* ^ . " - 



The. m(*^ns andr^tandard deviatioiTS'*trf-444e Coop Algebra Test scores 
for the exper^meiU^^l and.contrpl saniples, as'^well^a^Jfolr the several s\ib- 
groups, ar(? shpwn in Table 2,^below- It is see^n that the experimetital ^ 

(UICSM) sample ab a whole (and each siJbgrou^ thereof) \iad a higher mean' 

/ ' ' - « ' rv ' " ' ' * - 

score than'eitb.cr of the ci^titrol (** conventional ") subgroups. ' The superior 

- ' , - * • -.^ . . 

t performance of QICSM-ti-ained students musi, however, be partly attri- 
bated to thc/selection factor: they rep're;sent,ed the upper'* two-thirds' of ♦ . 



rable 2,, .Means ai^d- Standard Aviations of the Coop^lgebra Tests/ ^ 
'DAT-VtR, ^and DAT-NA for the experimental and control 
• , sa^^les and the several subgroups thereof. {Also' shown^* y 
are the -doefficients of multiple correlation of Coop * ' 
^l^gebra on the two DAT.subscores. ) ' . ' 



^ : - 

TEST " 



• Total 
Blxperimental 



.4> 



'Mean S. D. ' Mean* S. D. Mean 



Coop Algebra 
DAT-VR . • 
D^T-NA 
Miiltiplte r 



63,37 10. 19 
fh, 98 . 8. 11 
24.62 7.19 
. 645 




66. 89 10.03, 62, 83 10.10 66.58- 7.94 

2?; 39 ^ 7.61 26.92 8*. 18 -28.42 7.51 

'23.72' 7!^ 24.76 6. 98 26. 14 5.62 

. . 670 • • . 653 • . 602 



T.EST 



E. 



-E 



6 . 



Coop Algebra 

• - 'J " 
DAT-VR 

DAT-NA 

" Multiple r 



■ ^4^^P ^ iM p.. ' Mean >£. D.;^ Mean- S,D. Mekn S. P. 

59.." 5.7 11.22 '^^5. 83 8.6"l 6,3.i8.9.5Q 



63.72* ^S-.48 
28. 57- '."7. 86 
25. 6^ ' 6'. "68 

.660 : ■ 



E4.22 8. 3^ "28. 62 7. 68' 28: 9'5" ,7. 02 

fir * 

22. '7.66 ',26,04 6.39 /25.76' 5.51 



671 



-527 



649 



•TfiST* 



' Total 
C om r ol 



Mean 



S.D,- iClean ^ S. D. Mean S. D. 



Co6p Algebra 58. 26 iCjC)9 
'DAT-VR. 
DAT-I^A * 
Multiple r ^ 



23 . 63 .87^^ 
21.26.V 7.20 
•• .673 



58i77 H. 33 • 56. 65-.. 10. 11 
23. ,46 -8.23 24.19 T;27 

' . • ' .■ -.c 

21.66 7.38 23.09 ' 6.48 



.718 



569 



ThJb hol-ms for thi's test, based on-.15, 000 students in 130 schools, *how a 
mean of ^2.9 with a standard deviation of 9. 6.» " '■^ 



'At ' 



the college preparatory students in each school, as mentioned e^^rlier. On 
th&. other "hanci, the control sample was fWmed frdm algeBra classes for 
wh'iolJ^be admissfc>q^equirexp.eTlt*s were generally not so string-ent*, 

i^prder tp^ijaake adjustments for the inequality in ** scholastic ability* 



hTgCween the exp^rime'ntal and g^Qnt^ol samples, , the Differential Aptitude 
•Tfest Battery (DA^j re<sults for all individuals in our sample were employed* 
This battery had been administered prior to the students'-taking theit alge- 
bra courses, UICSM or '^conVentionar^, as the case may ]?e/ Specifici^riyj * 
the scores on the two subtests- --Verbal Reasoniiig (VR) and Numerical 
Ability (NA).-- of the DA^ were us^ed aS statistical control vardabljBS as 
described in the next section. The means and ^^tajidard deviations of 
DAT-V.R and DAT-NA for^the various groups ^re shovm in Table 2, -As to 
be expected, the experimental groups have higher means than t)ie control 
groups. ^ ' 

V 

It*is recognized. that aiiju^tments for DAT-VR and DAT-NA scores 
are probably insufficient to compensate ^or all the relevant but uncontrolled^ 
inequalities e::^isting between experimental and control samples * For 
instance, tbe \* teacher variable'* is quite likely to be a si^nificant^factor 
Contributing to the difference in algebraic achievement between the two 



4,^ 



^^a^rnpip^s . But the ofjfcjr measure available for assessing **teacher compe- 

trace'* was the very ?^rude one of the nuthber of years of experience, and 

it was -decided that, little )vx>uld be^gained by making adjustments for thi$^^* ^ ^ 

variable. The adjustments ^yhich we made, therefore, probably repre* 

sent the most that c'6uld be done within fhe Ijmits of available data, 

- Some indication of the* extent to which_ythe$e adjust- 
ments were effective can be gaineld by examining the magni- 
^ * • tudes of the coefficients of multiple correlation oi Cqop Algebra ^ 
scores on the two DAT subscores. These i^anged from about 

■■- • ,. ; • -1, . ,-. . 



.53 to .TJ>f ciepending on the particular group, as'-shqwn in 
Table 2, Thus^ it can*be argued that the two DAT scores , 
accounted for from 30 to 50 percent of the variance 'in the 
Coop .scores . 



I 



Statistical Analysis 

. The statistical technique used for making a majority of the intergroup 

comparisons described below was /the standard analysis of covariance# 

This technique amounts to making an estimate of what the Coop Algebra 

mean of each group under comparison would have been if the DAT-VR and 

DAT-NA means 'had each been equal for the several groups, and tken 

making a comparison between these estimated (or ** adjusted") Coop Alge- / 

bra means. ^ 

In actual practice,, it ^s the sums-of-s<^uareS'of the 
Coop' Algebra tests that are adjusted. The iest^of signifi- 
^ cance then exactly parallels that for the u^ual analysis of^ 
° variance. TJiat is, the ratio ojE'the adjusted between-groups 
/nean-squa're to the adjusted within-gr oups meanVsquafe is , 
used as an Frratio, If the value of this ratio exceeds a criti- 
cal value, the adjusted Coop Algebra means are judged to be 
significantly different from each other. 



, In this manner, comparisons were made between the experimental 
sample as a whole and tife, corftrol sample as a whole; between groups 
thfougK (9th gfade classes in experimental sample) and the control 
sample; and*so forth. Each comparisoiT was clesigned to test the effect o£ 
som^ particular variable or combination of variables on whiafti the contrasted 
giC oups 'differed systematically.. " , * ' . 

Experimental Sample vs. Control Sample d analysis -of -variance 

table for the adjust^^ sum-of^squares (S.S.) in this com{)arisoh^ shown 
in Table 3, as are the adjusted means. 



T^ble 3% Adjusted analysis^^of^vai^Mfcce table for^ comparing, 
• . experirqent'^l group an<i/control group sample Coop 
. ^ Algebra means ^\ ^ ; 



Source -^Adjijstfed SlS. n. d. f. Adjusted Mean-Square F -ra tio 
Between-groups " 1944.83 .1 -1944.8^; ^ 31,19 

Within'-groups . 148214.00 2377 62.35 



Total . . .' - 2378 



/ 



^ " Group E^^^^j,' = '62. 50 ^ 

Adiusted .Coop^Algebra means ' < . & 



f 



GVoupt:^^^^^ =:*60.45 . P/< .001 



The TesuIting.F-ratio (31. .19) indicates that the adjusted Coop Algebra 
• • - - - * » ^ \ , 

rneatns for the two samples are significantly different at the ,001-level, the 

direction of the difference being in favor of the experimental (UICSM) 
*^ample. It should (be noted that the adjustments for inequalities on the two 
DAT means have lowered the experinqenfal sample's. Coop Algebra' mean 
fr/>m 63 . 37 (cf.; Table* 2) to 62. 50, and raised the corresponding control- 
sample mean from 5,8.26 (cf. Table 2) \o 60.45. ^This is the way in which 
the analysis of covariance methp^ operates in order, at least partly, to' 
^cornpensate for group inequalities on related variables. ' ' T . » ' 

We rtiay thus.conelude that the UICSM sample as a whole showed a 

' y • ■ . 

significantly higher algebra achievement (as measured by the Cooperative 

^ ^ *. ' ^ 

Elementary Algebra Test) than did the "conventional" algebra. sample «s a 
whole--even when due compensations are made- for the fact th^t the former 
was superior £o the latter in- general academic ^biMty as measured by the. 
DAT Verbal RekS'oning and Nume^rical Ability sjcpres. • 



Group j;:^^ vs> Groups E^^° In view of tKe fact (cf /Table 2) 

that the 8th -grade experimental classes (group E^) scored ^considerably 

higher on the Coop than did'the 9lh-grade experimental glasses 

(groups (^y)' pertinent to inquire whether the meaixs foT these 

two subr^samples are significantly different.^ For if so, -there arises the 

possibility that tjie superiority, seen above, of the e^qperimental sample 

is attributalple to ju$t the 8th -grade segment, which constitutes about 13% 

of the experimental" sample. < . j 

The adjusted^analysis-of-variance table for the experimental 8th*- vs. 

9th-gfade comp^r^son is sh£wn in Table 4. The resulting F-ratio indicates 

a significant difference in 'favor of the experimental 8th-grade classes. 

Note that,' in this casje, the adjustments have widened 
*- . *• 

the gap' between the group means under comparison. Refer- / 

eye to Table 2 shows that the 8th graders had a lower DAT*- 

NA mean than the 9th graders, although the DAT-VR mean of 

the former was higher than that of the latter- Hence, the 

adjustments foj; the two predrttors W43rked in opposite dir- 

' exrttons in this case, and the'fact that the-8th-gradef 'mean was 

.raised iTX>rn\66. 89 to 67. 33 while that of the '9tK grader was 

lowered from 62.83 to 62.76 indicates' the overriding effect 

of the compensation for unequal , Numerical Abilify s.cores. 



■ ^At any rate,, since the 8th-gra,de classes were found to be signifi- 

, * , / ^' 

^ cantly superior to th<#*9th -grade fxperimer^tal closes on^ the -'Coop Algebrk 

Test, it is desira^ble to inquire whet;her or not the superiority of t^he experi- 

v'^ rnental to the cojitrol sample will cfontinue to hold when l^e 8th'-^rade 

'group is -removed from the expei^imental sample'. 
' ^ » * « 

^ Experimental Group,s,.E^2 5) Control* Sample. That the* 

answer to the question poeed abov^ is in t he affirmative tan be seen from 

♦ * 

the results presented in Table 6. The experiipiental sample slhows a 
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.significantly higher overall perfo,„,ance on^the Coop Algebra Test than ' 
"the control sample, eCexX after the' especially high-scoring experimental 
group (the 8th-|rade classesvVs removed fnom-consideration: ' 



" '^^j-sted analysis ofvarxance table for cpmparing Group Ej 

« aA'd GfouDs . rJ^^^^c „_ y, . 



lAd Groups £^2. _ , . 6) means on Coop Algebra 



So^frce 



Adjusted S/S. -n.d.f. 



-Between-gra^ps ^ 2627.47 ' 
Within-groups • 99,082/24 
Total * 



/I 
1701 
\102 



Adjusted Mean-Square F*- ratio 
• 47 " ^.'79* 

; 



.47 
58,25 



A J- , • , L .' Group E, 

Adjusted Coop Algebra means • . ^ 

^. ♦ . . ' ' ' * % . Group E 



(2..: ..6) 



67. 33 
6^. 76 



■p < ,001 



Table '5. Adjusted Analysis o*f variance table for coifTparing 

experimental groups E^^. ^ . 6) '^^^ control- sample 
^ nieaixs on Coop'Algebra ^ . 



Soui'co 



Bety^eeh-gitj^ps 



AdjustedS.sr n,dj^ Adjusted Mean-Sq n;.r. ' 



911.21 



1 



■9H'..21 



^ Within-gr^ups^ ^14,504. 11° 2151 , '61.14 
' ' 2152 • . 



14, 90 



* 



1 5 



, T- . •! V Groups E,_, 

... Adjusted. Coop Algebj-a lyieans ^; (2. , 

• ' Group C 

' ^ total 



6) = 61.85 
= 60.04^ 



■P < ,001 



. Id 



Individual Experimental Groups vs. ^C6ntrol Sampled We -now com - ^ 
pare -ifech^txf the experimental. 9tii -grade groups {E^, E.y E^'^nd Eg),.^in ^ 
turn, wi1;ii the control sample, ^^Qroug E^ \^^not considered because it - 
ivks'both vjxy smhl size (N = 1351 and extreme^ih its de^layf detesting 
tirhe, as seen in table 1. ^Ihfe resuljfs oX the' f 6ur ^p^nparisons^are sum- 
*rharized in Table 6, showing'that t^o of the eKgeriTneiitaX group's {E,2 and Ej^)^ 

\ . ^ • ; ' 

were found to be significantly superior to the control sample while two* 
(E'-j and E* ) were not' significantly difle^rent fi^oilri^itr^ ' * ; . i ; * • 

» It should be Wilted ouV'fhat/ fii-r tKe cpx^pa^ispn invol- ' ^ ^ 

, • ving g»pup Eg, ^an unr'es.tri.pted linear hypp rii,odel ;J 

^ (using separate\group r^gre^sion*iv^rgiit^)' wik9 us.ed *^n8te,^d/ - 
bf the standard c^varianoe an^aly^is. ^ "Ajis^^ bec^US'e the; . 
equality -o*f- slopes conditi*on/jj>refeauiSlte^tb ;r,^gula^^ ^ i 

'.! ' V ^ *V>W ' \ ' ^ ^ , \ 

» • anae analysis^ was-not satisC^^Qd^ip .this^ case^ ' v ^ . /• -^^ * ^ 

The two experimental gi?„Aups tjhaf fai^ledjjb dchiev.e.>dju^t^J*Co^^^^ 
r^a means which.weiie/sigiaificantly^ijg^er than* that* *aff>the ,cotitrol ^ 



Th( 
Algebr^a 

sample apparentlyvdi(J^ sb jfcSr 'ty^o di-^erenVrl^ason^/^ claai^^s', \ 

Jhaving taken"" their UICSlJ course>ripi^/tb the revision of;mater;alfe, 

were at a. disadvantage as ^oted.e2t^Uefp^nmtyJ:h%vin^ 2l 
the manipulative skills. Grovi^ E^, prt the^^Qthe^!^B,nd, was test.ed before 
completidrf of Unit 4,*' and*ie!n<:e ha4 npt,%y^ co.^5e^^ea some of the tp^pics* 
that were included in the Gopp, t^e^V, ^ ' . , ^ 

. * * • ' ' ^! ' ' • • • ' 

GroujfS E; was iri the mosi*advahtageous positioh of the four e^eri- 

' ' ' / . ' • v. . * . 

'ipental groups'!, ^bes-e'tlasses, vt^ere taught wlth'th^ revised material, which 

contained more exercises in computation, andihey ,were j;ested after 

"VVe are^n4ebted*t6 Dr; .F'r anl^ .Watson^ of the Qffic^.of Instructional Tele- 
vision, University of ^llinois,. ior m^^king ayailable to, us l}is progratn fot^, 
carrying out this test, and to Mr/ James "Henhes for its actuaVex:ecU€ion^ 
on the IBls/L 70 90 computer;' ^ ' , \ ^ / / ' ; 



*• " '^ Table 6.' Comparison of 'experin><2nt:al groups p'," E^, E., E^, 

. each y/ith. control sample/ dn, Coop -Alg'eKra means 
> > * » , • ' s / , * 



'3 • 



^ ' (a) .Group vs. Qroup C^^^^^ 



.Source Adjusted. S> S. n, 4* ^- Adjusted Mean-5q>uare ratio 

:,Betwe/fen-grpups 1103.91- ^ -l- ' . 1103.91 - i-7.57 

^ Within-groups/ . 49639.25 790' ! 62.83 - 

^ Total \ : 791^ ' ^ ' ^--i-* . ' 



5^ 



> Group E2 ' , *= '62.41 ^ 

Adjust-ed Coop Algebra means . " P < ..DDI 

, Group C ' , = 58. 99 ' 

. - ^ total 



0> 



• ■H 



(b) Group'E3 ys. Group C;^^^^ ^. ^ . * ■ 

• \ — ^ — ■ • • ■ • " 

Source^ Adjusted S. S. ' nvd. f. Adjusted .Mean-Square F-ratio 



■^i , B^tween-groups ^/>va50.53 '1 • ^50.53 . 2.53 



' Within-groups 56011.36 • " 942 '■59.46 ;,, 



3 



Total / A. / 943 



• ■. ; . ■ ■ • ' 'Group'Ej _ = 60.48 ".'^ _ \ 

^_^. Adjireted Coop Algebra means ^ ' " • . ^ ijot signi^. 

. Group C-J'^^^j = 59.56^ 



~ — r 



' .Table 6. (continued) 



(r) •Gr<nip E^^ys. 'Group 



tola] 



Source , ^ '> Adjusted S. S. n. d. £. 
Betv/een-groups 45r, 21 1 

1246 

Total / li47 



• 45. 21 H " ' 

67.-74 



■9- 



! Group .E^ - 59.07 



Adju3ted Coop Algebra meai/s 



{d) Group fe^'v?? Grouj!) C ^^^^ 



ERIC 



Differen^^e between adjusted means 

, *- *(Gro\ip minus *Gri!^ut) C - ^ ) 
standard erroi; o 

» = SA7 . / (P < .001)'- 



.3.00 
. 538 



CDmpletion of -init 4. It would have been quite discouraging for UICSM if 

r- ' * J ' ' 

* this gtoup had not excelled over the control sample; but it did., 

* ' I ^ ' ■ ' ' ■ 

Jhe success of Grbup {which combined the di^^advantage of--being 

taught' with pre- 1959 material and of being tested pronrtptjy at the end of 

the school^$ar), hn the other hand, is rather remarkable. At least part 

of this success must.be attributed to tKe group' s -exceptional superiority in 

general Sicholastxc abilit/-''as indicated by its being considerably above, the 
" / / • ' \ . 

overall dxperimental-sample average on DAT-VR, and the highest of all 
the groi/ps on DAT'-NA i,ci. Table 2). But tliere is also other evidence. 

• ■ ■ 2i/ . 



indicctting that more than one of the classes in this group iad highly com- 
"■petent teachers who successfully covered ali;nost the entire' first'course in 
one school year. This observatiou lends support t'o the surmise that, given 
th-csc favorable condition s/ the UltSM material, even without augmentation 
of coiYiputational drill exercises, was adec^uate in preparing superior stu- 
dents to copj? with such conventionally oriented^achievement tests as the 
Coop Algebra.. , * 

Experimental Grojips vs. Control Group C^. Prior to making the 
above comparisons be-tween each experimentpi!l group, in turn, with the 
entire control sample, we undertook to compare sorne of the experimental 
groups with control group C^. This group l^as a somewhat higher mean 
Coop Algebra score (58.77) than the other control group (56. 65), and we, 
therefc^re, thought that comparisons with group C^ would offer a more strin 
oent test than comparisons with the entire coritrol-s&mple. However, an 
obstacle wab encountered to pursuing this* plan, which^we sjiall describe ^ , 

below, and it was therefore decided to use the entire control samplers the 
* • ' * 

ba^sis of comparisons • 

The difficulty with using control, group C, alone" £qti.u. 
comparisons stems from tbe fact that the regression plane 
of Coop Algebra on the two .DAT subtests for this, group were 
.rnarkedly non-parallel to, those of most of the experimental^ 
g^ups. Thus, the equality- of -slopes condition, mentioned 
' earlier, would not'be satisfied, and the standard*|||J.ysis of 
covariance metlvod for comparing adjusted means.would not 

■ be applicable.* There are two alternative procedures that \ 
can be used in such cases, both, of which are based on an iin- 

■ restricted linear hypothesis mbdeL One of these procedures 
wes usedjor the group versus coptrol sample comparison, 

'cited earlier. The other is th6 Johnson-Neyjman technique, " ; 



which enables vis to spe5ify three regions in the cov^iate 



space (in this 'study the two-dimensional space with DAT-VR 
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and DATf-NA as the coordinate axes), such that the ,conclu - 

'nion'tu dravm depends on the region(s),in which the cen . 

troids 0^ ihe two groups under comparison falL If both 
^/ . * 

cen^YpidlV fall in, sayHRregion A, we conclude that group A 
has a significantly higher adjusted criterion me^an than group 
B; if bcm centroids fall in Region B, the reverse is.tru-e; ^ 
and if 0W2 Or botk of t^e centroids ^fall in the tfTird region, the 
differ'fepce is not significant* ' ' . ' t 

f<rrtunately, .it appears that the two procedures may, 
sometijffles lead to conflicting results, ai^ase at point being 
the fomdwing^ conclusions, (1) ajid (2) below, for the com- • 
parisciri between experimental group and control group 

(1) Separate-'grouff regressions : 

Difference between'^adjusted Coop means 
% .(in favor of group E^) - - 
Standard error of difference 
\ i - 2,97 {P < .01) . - ^ _ 

42) Johnson-Neyrnan technique: -* the Cj^ group centroid 

falls in the region favoring group E^, and the ^.mi- 
centroid tails in the region of non- significance. 
Thus, it seems t)iat, when the equality-of-slopes condi- 
tiori is not satisfied, we may not he able to draw unequivocal 
conchisions as we can when the standard coVariance analysis 
IS applicable. When the entire control sample was considered, 
the regression plane was not significantly non-parallel to that 
of most of the^ experimental groups. The single ^ception 
wds the case of group E^, alreai^y discussed, ^-nd it should 
hd mentioned here that for this* comparis.on ^e Johnson- 
Njeyman technique led to the same conclusion^as th^t ft-om 



= 6^.92 
= 2.33 



the se^arate-group-regressions approach, 

• ** 

Iroup E^ vs. Group E;^;. Group E^ vs.^ Group Eg, The last two com- 
p*:tribc/lis to be reported are those between pairs of groups in the experimental 

/ ■ . ' ' i 

sarnpleats^f. Specifically, th^ purpose was to cgmpare the 1958 (pre- 
revision) and 195^ (pqst-revision) classes,* holding relatively constant 
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*llie cimSSnt, o£ the^ course \ov€^red as of Ih'e time of testing/ ; Refei^ence to 
Table 1 showy that groups and (end*of-year testing) and groups, 
E_ arid E- (ead-of-coul4e testUig) arc the appropriate'pairs to comp'ar-e* > 
The results ^ire presented in Table 8* \ *« . 



Table B. Conip arisons^ w ithin the Exp erimental Sample 

''(Ninth Grade Groups) 



(a) Group vs.- Group j 



Source 



Adjusted S. 



Between-groaps 1012, 59 

Within-gr oups 44 , 58 1 /80 
Total 



n, d* f. 
1 

688 
689 



Adjusted Mean-Square F-ratio 
■ '1012.59 . 15/63 

64.80 



Adjusted Coop Algebra meatii 



I Group = 63.49 



Group ^t. - 60. 20 



P < .001 



(b) Group vs. Group E^. 



Source, 



Adjusted 



S.S. 



Bet"ween-group?^ 577. 1 10 

Within-groOps . 31, 5Z4. 05 
Totoi 



n. d. f. ^^cljusted Mean-Square F-ratio 



.1 
648 
649 



577'. 10 
48»65 



,-11.86: 



Adjusted Coop Algebra mean.s' 



Group = 63. 21 
Group = 65» 75 



P< .01 



It was already mentioned above that group was an exceptionally 
superior 'group. It is not surprising, therefore, that it Excelled' over ita 
1959 counter- part; grqup E.^ despite the latter' s having been exposed to 
a larger, number of drill exertises* »^ 

On the other hand, of the twb.gtoups which were tested after qqm- 
pletion of the course, group (1959) was significantly superior to group 
E^ (1958) in achievement. Thus', We find at least tentative evidence that 
/ the 1959* revision wa^ favprable to^better preparing UICSM students to . 
^chi-evc those skills that are stressed nn conventional algebra courses- 



Summary of Results ^ 
<% ' ' I 

- Since many diffei^ent comparisons were repotted to the foregoing, it 

may be helpful to present an overview that will enable the reader to see ^ 

tfie re^tilt.^ at a glance. We do this in two ways. -Fii-st, ,Figu/e 2 shpwsj 

*in ascending order, the sev^^al group means on Coop /S.lgebra,\ adjusted 

by a regression equation based Y»n the entire samiMe (experimental and >; 

control cbmbin.cd) . , # 
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Figure Z.- Aduisted Coop Algebra means for five experimental 



■ • ■ J 

arid two control groups (adjustments bas6cl on regression* 

equatic:)n "for combined sample)^ 

/CO"' • 
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Note that theae means do not ^agree with*''thos« reported 
"^e^riieT in different group*-b.y-^roup comparisons. This. is be- . 
cause the earlier adjustments^v^re each based on a regression ^ 
equation applicable to the particular pair of groups being 
cornpare^^while the present adjustments are ^ased on the ' 
' total sample, Tliese adjusted means" do notrenter into'signi- 
" hcancrc^tests, but they give a rou^.iBea of what the relative^ 
standings of the several grpups might have been if all group>6 ^ 
h^id bceji^^iJompJ^lrable in tferms of DAT-VR and DAJ'-NA means. 



Second, we snow ;n Table 9 a list of all the comparisons between var-- 
ious groups that were rfiade. An inequality sign in this table indicates 
\yhether the adjusted Qoop-'Algebra mean for the group^named on the left ^ 
margin- v/as significantly greater than (>), . significantly ^less tham(<), or' ^. 
^pt significantly different from { ) than^that for the other group. _ . 
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Tab^c .9. - Coixiea-risoja^^^agljusted group means ^ Coop Algebi'a 

Statistical test used: Standard Covariance- Analysis ^ - 



0 





* * 


















-r- Grcnipg 
Compared 


Acijus1?ed 'v^*'* 
Group Means ' 


F- ratio 




Conclusions 


^ . ^Uotal 


62.50 * 
60.45' ' 


. 31. 19 V 

* 


.< .001 


■^.total ^ ^'total > 


""{2... 6) 


» 

' "67.33 


• 

« 

3.4. 79. 


♦ * 

•< ."001 ■ 




'*^(2...6r) 

/ C total 


61.85 - 
60.04 * 


14. 90 . " 


< ..00 1' , 


^2.,, 6) ^ ^ total • 










— --'=:^ 




62.41 

58.99 


17. 57 


< .oor- 


■^2* total , 












total 


59.56 




.>'.05 

"H * 

> 


^3- ^..^ total ■ - 

• 


^ total 


■ 59.07- 
581 6'S: ;. 


.67 


\ > ? 0-9 , 


E = C ' 
4 *■ total 


* 


6 3 49' 

60. ^O' ; 


. 15.63 


■< .001 


> E . ' 


* * ' 


^ 7 ■ ■* 

63. Al 


''iir'86 


:V< .or\ 


5 3 
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.'xabit:r {contiBued) 



.3 



statistical test used: Unrestricted Linear HypqfSdesis ModeT 



Differences 
Between Standa^rd 
Adjui>'ted Error of 



Conclusions 



» Cojnputer Johnson- 
— J — - ' Program due Neyman 

Compared Mea^s . . Estimate t- ratio P . 'to Watson"'^ Technique^ 



1. 11 



2-93 



.38^ > .05 ^C, = C^ 



'^5 



total 



3.00 



538 5.-57 < .001 E.. > C,-, > C , , , 

i 5 total 5 total 

... • ' (P < . 05} 



E. 



6.'92 2. 33 



, 2.-97" < .01 E3 -> , 



a. 



, See toage. 13 ..^^ ""sf^ page. 



paae 1 6 



E3 = 

(P > .05) 



See pag©.;^,.. ' ^ -l 
. . ■ > 
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